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SPECIFICATION 

1. Title of the Invention 

Methods and apparatus for immunoploidy analysis 

2. Scope of the Claims 

[What is claimed is:] 

1. A method of analyzing a cell object population for 
a given parameter, said method comprising [the steps 
of]: 

• optically enhancing the cell object 
population for the parameter; 

• optically marking cell objects selected in the 
population for a particular feature; 

• displaying an enhanced image of the cell 
objects of the population to a user-observer 
using digital image processing; and 

• gating the cell objects in the analyzed 
population into several subpopulations based 
on morphological standards of the cell 
objects and the optical marking being 
viewed by the user-observer. 



2. An interactive method for analyzing a 
subpopulation of cell objects for a parameter given 
by a user-observer, said method conq}rising [the steps 
of]: 

• optically enhancing the cells of the 
subpopulation for the parameter; 

• optically marking selected cells of the 
subpopulation for another particular feature; 

• displaying an enhanced image of the cell 
objects of the subpopulation to a user- 
observer using digital image processing; and 

• gating the individual call objects in the 
analyzed subpopulation into several 
subpopulations based on morphological 
standards of the cellular material and the 
optical marking being viewed by the user- 
observer. 

3. An interactive method of analyzing a 
subpopulation of cell objects according to Claim 2, 
wherein the step of optically enhancing the 
subpopulation for a parameter includes the staining of 
the DNA of the cell objects. 

4. An interactive method of analyzing a 
subpopulation of cell objects according to Claim 2, 



wherein the step of optically marking selected cell 
objects of the subpopulation includes the selective 
marking of cell objects comprising a particular 
antigen. 

5. An interactive method for analyzing a 
subpopulation of cells according to Claim 4, wherein 
the step of selectively marking the cell objects 
comprising the particular antigen includes the 
staining of selected cells with an 
immunohistochemical technique employing 
monoclonal antibodies against the particular antigen. 

6. An interactive method for analyzing a 
subpopulation of cell objects according to Claim 5, 
wherein the step of staining the cells with an 
immunohistochemical technique includes staining 
with a alkaline phosphatase technique. 

7. A method for marking cell objects selected from a 
subpopulation and measuring the amount of DNA of 
cells of a predetermined class from the subpopulation 
comprising [the steps of]: 

• performing a furst staining of the cell objects 
of the subpopulation with an 
immunohistochemical technique that 
includes a monoclonal antibody specific 
against at least one protein of the cell objects 
to mark all cell objects that include the 
protein as a mold; and 

• a second staining of the DNA of all cell 
objects of the subpopulation using Feulgen 
staining. 

8. A method — being an apparatus* for analyzing cell 
objects of a ploidy on a support optically enhanced 
by enhancement including enhancement of the DNA 
of the cell objects using Feulgen staining and 
enhancement of both the position of the cell objects 
and the mass of specific protein portions by an 
immunohistochemical staining method — the 
apparatus conprising: 

• a means for enhancing an image of the cell 
objects; 

• a means for preparing an image filtered with 
a first filter by filtering an enhanced image 
at a wavelength relatively nontransmissive 
to the DNA staining during a comparison 
with the immunohistochemically stained 
section; 

• a means for providing an image filtered with 
a second filter by filtering the enhanced 



Translator's note: This claim claims both an apparatus 
and a method. 



image at a wavelength relatively 
nontransmissive to the 

immunohistochemically stained section 
during a comparison with the DNA stained 
section; 

• a means for digitizing and storing the image 
filtered by the first filter and the image 
filtered by the second filter; 

• a means for combining the image filtered 
with the first filter and the image filtered 
with the second filter in which cell objects 
with an immunohistochemically stained 
section are marked; 

• a means for displaying the combined images 
to a user; 

• a means for gating each cell object into one 
of several categories based on 
morphological standards of the DNA stained 
section and the section labeled with 
immunohistochemical staining; and 

• a means for measuring the DNA content of 
each cell object and gating the cell objects. 

9, A method for cellular analysis for determining the 
amount of a particular section of specimen cells 
selected from a cell subpopulation, said method 
comprising [the steps of]: 

• providing a control section and a specimen 
section on a microscope shde; 

• placing a predetermined amount of control 
ceils in the control section; 

• placing an unknown amount of the specimen 
cells in the specimen section; 

• staining the control cells and the specimen 
cell sections with the same dye; 

• staining selected cells of a different section 
of the specimen cells with a different dye; 

• measuring the optical density of the stained 
control cells; 

• determining the stained elements from an 
optical density measurement of the stained 
control cells and the predetermined mass of 
the control cells; 

• measuring the optical density of the section 
of an unknown amount for the class of 
specimen cells based on the morphological 
features thereof and selected cells of the 
differently stained section; and 

• determining the amount of the section of the 
class of specimen cells from the measured 
optical density and the staining factors. 

10. The measurement process with a variety of the 
stains and the staining colors, said measurement 
process including [the steps of]: 
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• identifying by selectively filtering an iniage 
of the cell population the different section of 
the selected cells; and 

• labeling cells at another stained section to 
make them the selected cells. 



3. Detailed Description of the Invention 
Industrial Field of Application 
The invention relates generally to the measurement of 
cell features and other parameters by image analysis 
and is more particularly directed to quantitative 
measurement methods and apparatus for DNA 
analysis of small cell populations. 

Prior Art and Problems the Invention is to Solve 
The present invention is directed to quantitative 
testing apparatus and methods diat may be used for a 
wide range of diagnostic and prognostic evaluations 
of various cells, antigens, or other biological 
materials taken from the human body. However, for 
purposes of illustration and ease of understanding, 
the invention will be disclosed in conjunction with its 
preferred use, which is the quantitative measurement 
of cellular DNA for the purpose of cancer diagnosis 
and prognosis. More specifically, the present 
invention is directed to methods and apparatus for 
interactive image analysis that are adapted to analyze 
and quantify the DNA in different classes of 
specimen cells taken from a human body. 

The current state of the art in the pathology 
laboratory for measuring the DNA content of a cell is 
by visual observation. A pathologist observes through 
a microscope primarily the shape and surface 
construction of suspected cancer cells and then 
classifies the cells into a normal category or into one 
of several abnormal or cancer categories. Such 
evaluations are very subjective and cannot 
differentiate and precisely quantify small changes in 
DNA within individual cells or in very small 
populations of abnormal cells. These small changes 
may represent an incipient stage of cancer or a 
change in cell structure due to treatment of the cancer 
by chemotherapy or radiatioa Such small changes 
are, therefore, inportant in the diagnosis and 
prognosis of these diseases. 

However, the advantage in diagnosis and 
prognosis of abnormal ploidy distributions that a 
pathologist viewing a specimen under a microscope 
has is the discerning expertise of a skilled person in 
classifying cells as normal or abnormal. There is an 
innate human ability to make relatively quick infinite 
gradations of classification, i.e., almost normal, 
slightly abnormal, etc. On the other hand, the 
classification and measurement of cell features and 
parameters manually by a pathologist on a cell-by- 



cell basis is extremely tedious and time consuming. 
Statistical analysis of such cell data taken by hand is 
relatively difficuh because each record has to be 
entered and then processed. For different records, 
taken at different times, and under varying conditions 
broad statistical categorizations may be unreliable. 

An alternative is automated cell analysis where 
the pathologist uses specialized equipment to perform 
the analysis. In automatic cell analysis, such as that 
accomplished by a flow cytometer, mass tests are 
performed in gross on a specimen cell population 
without a researcher being able to exclude or include 
certain data of the population. The specimen is 
measured "as is" without really knowing what cells 
are being measured and how many. Important single 
cell data or data from relatively small groups of cells 
are lost in the overall averaging of a specimen. 
Further, relatively large amounts of a specimen have 
to be used to provide results from these tests and the 
sanq)le is consumed. 

Although there are commercially available 
general-purpose flow cytometers, they are very 
expensive and can handle only liquid blood 
specimens or tissue disaggregations. These 
cytometers are incapable of working on standard 
tissue sections or using conventional microscope 
slides which are the preferred specimen forms of 
pathology laboratories. Additionally, a flow 
cytometer does not allow for the analysis of 
morphological features of cells such as texture, size 
and shape of cell nuclei and alterations in the nuclear- 
to-cytoplasmic ratios of cells. 

The methods and apparatus illustrated in the 
referenced Bacus applications have solved these and 
other problems relating to the analysis of various 
features and parameters of cell objects. Bacus 
discloses a measurement method and apparatus that 
can acquire accurate quantitative data concerning a 
plurality of individual cells very quickly by an 
interactive process with a pathologist or an operator. 

The Bacus apparatus provides means for 
displaying on a video monitor an image of a group of 
cells from a field of a microscope. The image is 
further digitized and stored in a memory of the 
apparatus. From the digitized image, a processor 
apparatus identifies each possible cell object 
automatically by a pattern recognition technique. An 
interactive program allows the operator to point to 
each object or cell in succession and make 
morphological decisions for classification and 
measurements concerning each. For quantitative 
DNA analysis, the measurement is of the optical 
density of the cell object and the classification is by a 
pathologist as to whether the cell appears normal or 
cancerous. The decisions include whether to accept 
or reject a particular cell for further measurement and 
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processing. The cell object, if selected, can then also 
be classified into one of several classifications for 
later statistical analysis. The apparatus further has 
means that permit the classification and storing of 
more than one image. 

When the apparatus is used for DNA analysis, 
tissue and cell specimens are applied to a slide which 
is then stained with a specific stain that combines 
proportionately with the DNA and essentially renders 
invisible the remainder of the cell so that the image 
analysis apparatus can measure the optical density of 
the DNA which is concentrated in the nucleus of the 
cell. The stain associates with the DNA to provide a 
detailed nuclear structure and pattern that may be 
visually observed and interpreted by the pathologist 
using the apparatus for classification. The amount of 
DNA in the malignant cells is substantially greater 
than that for normal cells because the malignant cells 
are usually dividing and replicating rapidly or the 
malignant cells have abnormal numbers of 
chromosomes or have defective chromosomes. 

The Bacus apparatus can not only detect minute 
alterations in the nucleus by providing a method for 
accurately measuring the DNA mass in picograms 
but also can measure and quantify the amount of 
DNA and relate it to stored statistical analyses to aid 
in diagnosis. More specifically, the invention allows 
an iterative analysis of specimen population cells and 
provides a histogram or other statistical display of the 
population distribution of the cells with respect to 
their DNA content and with respect to a standard 
DNA for normal cells so that subtle shifts in 
population distribution can be readily understood. To 
this end cell nuclei images are not only acquired and 
stored but the data therefrom can be integrated with 
other statistical data to provide multivariable 
analysis, discrimination of cells, histograms, and 
scattergrams of cells or cell populations. 

While the methods and apparatus described 
above are extremely useful and advance the art of 
anueploidy analysis by image processing, they are 
not as sensitive as they could be. With the progress in 
measuring the quantity and distribution of DNA in a 
cellular population, there has come the need to 
further refine and sensitize that analysis and 
characterization process. One area in which 
sensitivity of the above process can be improved is in 
the operator classification of cell types. 

The previous apparatus of Bacus relies mainly 
on the pathologist or operator to make a subjective 
judgment concerning the classification of cell types, 
and whether they are to be classified at all. This is a 
principal advantage of the apparatus where the 
expertise of the pathologist in discerning cell types is 
automated and measurement of specified parameters 
of the chosen cells is accurately made. However, it 



has been learned that different cell types that are 
really quite different structurally appear 
morphologically similar under the microscope. 

This is particularly true when the nuclear DNA 
has been enhanced by Feulgen staining. Such nuclear 
staining is for the purpose of enhancing the visual 
characteristics of the nuclei of the cells which contain 
the DNA, but that necessarily de-emphasizes the 
visual characteristics of the cytoplasm in the rest of 
the cell outside of the nucleus. The result is to allow 
easier image analysis and precise measurement of the 
DNA of the nuclear material, but at the same time 
this enhancement causes the loss of the visual 
morphological characteristics of the cytoplasm that a 
pathologist might use to distinguish one type of cell 
from another. Additionally, there are different cell 
types, which it is advantageous to classify separately, 
but this method provides no or only faint visual clues 
as to their differences. 

Thus, there is the need to alert a pathologist 
classifying the cell populations for DNA analysis 
with the Bacus instrument about the different cell 
types, whether by optical enhancement or otherwise. 
A more defmitive mechanism would be the use of 
some demonstrable marker on the cells themselves by 
which the pathologist can objectively separate the 
various cell types. There are known in the art many 
optical enhancement or marking techniques for cell 
populations, including those described in the above 
referenced Bacus applications. For example, since the 
advent of monoclonal antibody production, numerous 
antibodies have been developed which are specific 
for cellular components, either in the cytoplasm, 
nucleus or on the cell membrane. Some have ahready 
been used to type cells in pathology to assist in the 
definition of the cell of origin of a number of tumors 
where subjective morphology is equivocal. 

Among the most notable of these antibodies are 
antibodies to Leukocyte Common Antigens, which 
identify inflammatory cells, and antibodies to a 
family of cytoplasmic structural proteins called 
cytokeratins that identify cells arising from epithelial 
structures. Other antibodies to cytoplasmic 
components such as intermediate filaments can be 
utilized to identify cells that provide structural 
support, the so-called stromal cells. In addition, 
numerous antibodies exist which are more 
specifically related to individual tumor types. 
However, further optical enhancement of the 
cytoplasm for different types of cells is problematic 
in view of the current DNA staining technique. There 
are many difficulties, the least of which is that an 
optical enhancement factor for the cytoplasm should 
be compatible with the present imaging techniques 
using computer analysis of optical density and be 
required to provide such compatibility without 
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impairing the sensitivity of the imaging techniques 
for the present nuclear staining. Chemical 
compatibility with the present Feulgen staining 
technique also presents a major hurdle. Optical 
enhancement of the cytoplasm after Feulgen staining 
of the DNA is substantially unavailable because the 
Feulgen process is destructive of the cell cytoplasm 
and changes the way it appears normally. However, 
prior optical enhancement of the cytoplasm is equally 
as difficult because the Feulgen staining process is 
caustic with the use of highly acidic reagents that can 
easily destroy other optical enhancement factors. 
iMoreover, if done prior to Feulgen staining, the 
optical enhancement process of the cytoplasm carmot 
affect the nuclear material in a manner such that the 
result of the subsequent Feulgen staining will be 
changed. 

Means for Solving the Problems 

The invention provides methods and apparatus for the 
measurement of selective features and parameters of 
cells in a population by the optical identification of 
their type. More specifically, the invention measures 
the DNA content of cells of a subpopulation that is 
selected from a larger population based on optically 
marking certain cells in the population. 

In a preferred embodiment the optical marking 
of the cell types is effected by binding an optical 
enhancement factor, such as a chromogen, to a 
specific protein in the cytoplasm of a cell in order to 
type a cell. Particularly, a monoclonal antibody 
specific to the cytoplasmic protein binds to the 
protein site and is magnified by an enzyme 
development technique. After certain types of cells in 
the population have been tagged with a protein- 
specific optical enhancement, a Feulgen staining 
process is used to stain the nuclear DNA in all of the 
cells. An imaging apparatus is then used for the 
computerized image analysis of the cell population. 
The apparatus provides means for displaying on a 
video monitor an image of the cell population fi-om a 
field of a microscope slide. The image is digitized 
and separated into two separate images where in the 
first the DNA stained areas are visible and in the 
second the optically enhanced cytoplasm areas are 
visible. The two image areas are combined and those 
cells that contain optically enhanced cytoplasm areas 
are marked so that the operator can visualize those 
specific cells. 

From DNA areas converted to digital signals, the 
imaging apparatus identifies each possible cell object 
automatically by a pattern recognition technique. An 
interactive program allows a pathologist to designate 
each identified object or cell in succession to make 
decisions for classification and measurements 
concerning each. The marked cells can be 



specifically excluded from a subpopulation by the 
classification process or specifically included. They 
may further be identified as to DNA content in a 
separate classification. 

By combining the marking or identification of 
certain types of cells by an immunohistochemical 
technique with DNA Feulgen staining, the ability to 
perform DNA content analysis with a greater degree 
of accuracy and sensitivity is enhanced. This greater 
sensitivity provides at least two more avenues of 
diagnostic and prognostic utility for human tumors. 
In one method, the immunologic marking can be used 
to mark which of the cells of a particular population 
are not derived from the tumor, leaving the remaining 
cells which are not marked immunologically to be 
analyzed for DNA content. This method is 
advantageous where a moderate number of 
inflammatory cells are present in a tumor. Thus, 
using an antibody to leukocyte common antigen, the 
immunological marking can identify these 
inflammatory cells so they can be excluded from the 
DNA assay. Alternatively, when the tumor cells are 
relatively rare and non- tumor cells make up the 
majority of the cells available for analysis, using 
immunohistochemical marking which specifically 
identify tumor cells provides a much easier and more 
sensitive determination of DNA mass for a cell 
population. In this case, antibodies to cytokeratin are 
utilized to identify epithelial derived tumors such as 
carcinomas. The analysis will then be focused on 
these cell types while discarding cells negative for 
cytokeratin as being inflammatory or support cells. 

One specific embodiment of the invention 
includes staining of the cell population with an 
alkaline phosphatase technique utilizing a 
monoclonal antibody against a specific cytoplasmic 
antigen. The resulting stain is adequately specific to 
the cytoplasm and does not stain the nucleus of the 
cells. A Feulgen staining process using Thionin is 
then performed to stain the DNA in the nucleus of 
each cell. The alkaline phosphatase staining method 
is used because of its compatibility with the Feulgen 
staining technique. The alkaline phosphatase staining 
is specific to the cytoplasmic antigen binding the 
chosen monoclonal antibody and does not harm the 
nuclear material so that it may receive the Feulgen 
stain in a subsequent step. The alkaline phosphatase 
staining is accomplished first before the destruction 
of the cytoplasm using the Feulgen staining 
technique. The chromogen chosen for the staining 
technique is a fast red dye that is useful for two 
reasons. In the first instance the fast red dye that is 
precipitated is not susceptible to being washed out by 
the Feulgen stain process and thus will remain for the 
optical visualization. The second reason is that the 
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chromogen provides optical separation from the blue 
Thionin dye used in the Feulgen staining process. 

Accordingly, a primary object of the invention is 
to provide a new and improved mediod and apparatus 
for analyzing cells or other biological materials by 
using image analysis techniques. 

Another object of the invention is to provide new 
and inproved methods and apparatus for making a 
quantitative ploidy analysis of ceils using image 
pattern recognition equipment. Other objects, 
features, and aspects of the invention will become 
clear upon reading the following detailed description 
in conjunction with the appended drawings. 

The apparatus illustrated in Figs. 1 and 2 and the 
methods described herein can be used to develop 
histograms, and other statistical data, of cell 
populations for the diagnosis and prognosis of 
malignancies and other diseases. Specifically, the 
quantity and distribution of nuclear DNA in separate 
or combined classifications of cell populations is 
available. To illustrate the utility of such statistical 
analyses reference is directed to Figs, lA-lD. 

Referring now to Fig. lA there is shown a 
normal ploidy histogram having a typical cell number 
versus mass distribution for healthy, non-dividing 
cells. The number of cells is provided on the ordinate 
axis and their nuclear DNA mass on the abscissa. If 
the cell population shown in the figure is not 
dividing, the DNA content should be peaked around a 
normal peak GO/Gl that is the diploid amount, 7,18 
picograms per cell. This relative mass of DNA is 
labeled as 1.0 to normalize the abscissa of the 
histogram. Fig. 1 B also shows a normal cell 
population that is dividing, such that there is a 
marked GO/Gl peak at 1.0 and a second peak G2 at 
2.0. The peak at 2.0 is normal because some of the 
cells are in division and have double the normal 
amount of DNA. The saddle S between the two peaks 
is relatively low and does not indicate any 
abnormality. 

Comparing the histogram in Fig. IC with the 
first two, it is seen that this cell population is skewed 
from normal by having a higher first peak around 1.5 
and a second peak aroimd 3.0. Further, the saddle S is 
more pronounced and can have cell count spikes. 

This histogram may show a malignancy because 
of the abnormally high DNA content for many of the 
cells. This high DNA content is likely indicative of 
the increased ploidy amount of malignant cells that 
are rapidly dividing. Likewise, in Fig. ID it is shown 
that the GO/Gl peak occurs at 1.0 with a normal 
diploid amount of DNA but has a relatively large 
trailing saddle from 1.0 to 2.8. A normal G2 second 
peak is not noted and is indicative of an abnormal 
cell population. The shape of the histogram is likely 
due to abnormal DNA amounts in cells and clones of 



cells indicative of malignancy. Therefore, from the 
shapes and changes in cell distribution histograms, 
diagnostic and prognostic information can be 
obtained. 

DNA analysis of human cells has been shown to 
have both diagnostic and prognostic utility for human 
tumors. 

As with any test, its usefulness is dependent on 
both the accuracy and sensitivity of the technique 
employed for the analysis. 

If a tumor specimen were composed only of the 
tumor cells, the accuracy and sensitivity of the 
illustrated technique would be a function of the DNA 
staining and the accuracy of the measuring 
instrument. However, tumors are most commonly 
composed of a mixture of cell types. In addition to 
the tumor cells one finds the normal tissue from 
which the tumor arose, supportive and structural 
elements and a variety of inflammatory cells and 
cells that are part of the repair and defense process of 
the host. These cells vary in amount from tumor to 
tumor and may indeed numerically overshadow the 
tumor cells in many cases. 

If non-tumor cells are included in the histograms 
of the DNA analysis illustrated, several errors can 
occur: 

1. An insufficient number of tumor cells may 
be identified resulting in a tumor 
inappropriately being assigned a normal 
DNA content; 

2. In tumors with a normal DNA content, the 
normal cells will exaggerate the peak on the 
histogram where the resting tumor cells 
appear and artificially lower the percentages 
of proliferating tumor cells; 

3 . If the non-tumor cells themselves are 
proliferating, they will give an artificially 
elevation to the assessment of proliferating 
activity in the tumor. 

Thus, an improvement to the DNA analysis 
could be made with a mechanism to appropriately 
eliminate irrelevant cells. Among the potential 
mechanisms are to attempt to distinguish tumor cells 
from non-tumor cells by cell size and shape 
characteristics, either quantitatively or by subjective 
morphologic assessment by a pathologist. The 
quantitative method is not useful in that tumor cells 
themselves can vary significantly in size and shape 
and there is substantial overlap between these 
parameters in tumor cells and those seen in the non- 
tumor type cells. The subjective morphologic method 
is more useful in that it takes into account multiple 
diagnostic criteria. Conventional apparatuses take 
advantage of this by allowing the pathologist to use 
his subjective skills to separate the tumor cells from 
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the non-tumor cells for DNA analysis. One problem 
is that the pathologist traditionally uses 
characteristics of both the nucleus and the cytoplasm 
to make these subjective judgments. However, when 
dealing with the previously disclosed method of 
analysis, only the nucleus is stained making any 
morphologic assessment more difficult. The 
invention solves this problem by the optical 
enhancement or the marking of selected cells, which 
exhibit a certain characteristic or type to identify 
them immediately. 

In the implementation shown, the system is a 
computerized image analysis system designed to 
measure a number of cell object features and 
parameters from their image on a typical glass slide. 
The instrument includes a sophisticated digital image 
processing system controlled by software to perform 
quantitative analysis on individual cells for nuclear 
DNA content by Feulgen staining as well as 
measurement of other nuclear features. The imaging 
system couples the ability of a pathologist to identify 
and classify cells to be measured with the capability 
of computer enhanced, high resolution digital video 
image processing to quantify optical and stain density 
accurately. Further, the system optically marks 
certain types of cells such that the pathologist in 
making his classifications can include or exclude 
them from the study to irr^rove the sensitivity of the 
process. In general, a pathologist first prepares a 
needle aspirate preparation of fresh tissue. The 
sanq)le is first stained with a alkaline phosphatase 
technique using a monoclonal antibody specific 
against an antigen in the cellular cytoplasm. The 
nuclear DNA is then stained by the Feulgen 
technique using Thionin as the dye or optical 
enhancement factor. After fixation and staining, the 
preparation is ready for analysis. 

The operator has the option of classifying the 
cells morphologically into any one of six categories 
or rejecting inappropriate cells or debris. The cell 
data are processed by a system control and the 
cellular elements are characterized by a quantitative 
DNA analysis for each cell class. The information 
when compared with either a standard cell calibration 
or published data allows a pathologist to accurately 
quantify and classify abnormalities that might 
ordinarily be described only literally from the image. 

The addition of quantitative data enables 
pathologists to perform their work in a more 
standardized and reproducible manner. The system is 
of value in classifying lesions that may be malignant 
and in providing prognostic information for known 
malignancies based on DNA content. The image 
identification system is more advantageous than 
common flow cytometry methods of evaluating DNA 
content. Flow cytometry permits an operator to 



classify neoplastic cells based only on cell markers. 
The pathologist, however, never sees the cells that 
the instrument has examined. In addition, the cell 
preparation must be used in a short time frame and is 
consumed in the course of the study. Although a 
permanent section of a tumor under study may be 
examined at the same time, there is no guarantee that 
the same cells are examined in both areas. 
Furthermore, the quantity of tumor available may not 
be large enough to permit a flow cytometric 
examination. 

In the invention, the quantitative DNA analysis 
is performed rapidly for the measurement of DNA 
and ploidy distribution pattern in a cell population 
under study. The pathologist advantageously selects 
the cells that are to be used in the population 
measiu-ements. The measurement of DNA content is 
useftil and believed to be relevant in diagnosing and 
determining prognosis for a variety of tumors in 
locations such as the breast, colorectum, and prostate. 
The system takes advantage of the skill of the 
padiologist and the selected cell marking to visually 
identify and classify abnormal cells, and then uses the 
conq)uter aided imaging analysis to analyze 
quantitatively those particular cells selected for the 
parameters desired. Such instrument advantageously 
expands and augments the recognition and diagnostic 
skills of the pathologist. 

As shown in Figs. 1 and 2, the invention is 
embodied as an apparatus 11 (Fig. 1) which 
functionally operates as a digital image analysis and 
processing system 13 (Fig. 2). The apparatus 11 
comprises a high-resolution microscope 15 with 
which an operator can view magnified specimens on 
a support, in a preferred embodiment a glass slide 14. 
The microscope 15 includes an adjustment or 
positioning device 70 for focusing its optics 16 on the 
slide 14 and a platform 51 movable incrementally in 
X and Y directions via positioning devices 12 and 17 
in order to view different areas thereof. 

Positioning devices 12, 17 and 70 are in the form 
of mechanical adjustment verniers that are 
conventional for instrument quality microscopes. 

The specimens in the field under study are 
further viewable by the imaging system 13 via image 
acquisition apparatus 18 (Fig. 2). The apparatus 18 
receives the light intensities of the image of the field 
and converts them into two analog signals (Red, 
Blue) that can be sampled and processed by the 
image analysis system 13. The image analysis system 
13 is controlled by a system control 22 in the form of 
a digital processor such as a personal computer. An 
operator, such as a pathologist or laboratory 
technician, can interactively communicate with the 
system control 22 via a keyboard 36, and interacts 
further with the system to quantify nuclear DNA and 
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classify cell objects by the viewing of two displays or 
monitors. A first display, image monitor 37, is a 
conventional RGB video monitor which displays 
through the system control 22 and the image 
acquisition apparatus 18, the same image field as 
seen through the microscope 15. A second display, 
instruction monitor 62, is another conventional RGB 
video monitor and is used to provide the operator 
with interactive prompts, messages, information, and 
instruction screens from a system program executed 
by the system control 22. 

The keyboard 36 is preferably a conventional AT 
type keyboard which has on the left-hand side a 
plurality of function keys, in the middle a plurality of 
alphanumeric keys including the special keys of 
ENTER, SHIFT, CONTROL, and ALTERNATE, 
and on the right-hand side cursor control keys 
including up, down, left and right arrow keys, a 
numeric keypad, a numeric lock key, and an escape 
key. A keyboard interface 35 translates the 
keystrokes of the operator into numerical codes 
recognized by the system control 22 for specific key 
indications. A printer 38 is provided for producing 
reliable hard copy output of the statistical data and 
reports produced by the apparatus 1 1 . 

A fiinctional schematic of the apparatus 11 is 
illustrated in Fig. 2 as image analysis and processing 
system 13. The image processing system 13 is used 
to analyze a plurality of specimen cell objects on the 
support, glass slide 14, of the microscope 15. Suitable 
high-resolution microscope optics 16 receive light 
from a variable intensity source 19 and transmit the 
light through the slide 14. 

Because the source 19 transmits light through the 
ceil objects on slide 14, the optical density of each 
pixel of the image will convert the light into a 
different intensity depending upon its percentage of 
transmission. Areas with no cell objects in them will 
appear relatively light or intense and areas having 
objects that transmit light poorly will appear darker. 
In general, unmodified cell objects are relatively 
transparent and their features difficult to distinguish. 
Staining the cell objects allows an optical 
enhancement of the features stained so they will 
appear darker than other features or their background. 
The optical image of each of the cell objects on the 
slide 14 passes through an optical image splitter 25. 
On one side of the splitter 25, the image acquisition 
apparatus 18, or other detector, converts the optical 
images point by point into two scanned electronic 
signals (Red, Blue) representing a monochromatic 
representation of the optical intensity of each point in 
the image on the other side of the splitter 25, a true 
color image of the field is provided to the operator by 
viewing optics 24. 



Fig. 3 illustrates the optical filtering and splitting 
of the image performed by the image acquisition 
apparatus 18. The focused image formed by the light 
intensities is transmitted substantially vertically 
through the slide 14 and enters the image splitter 25 
mounted in a holder 53. The first true color image 
passes vertically therethrough. 

A second true color image is further transmitted 
by the image splitter 25 perpendicular to the vertical 
path through the focusing lens 1 54 to image 
acquisition apparatus 18. The image acquisition 
apparatus 18 comprises a plurality of optical elements 
including a second image splitter 156, mirrors 158, 
160 and 162, and two monochromatic optical filters 
164 and 166. The image acquisition apparatus 18 
further includes dual video cameras 168 and 170 that 
each captures a portion of the split image. After the 
second true color image is split from the microscope 
optics, it passes into the second beam splitter 156 
where along one path the image is reflected by mirror 
158, passes through filter 164 and is imaged by 
camera 168. Along a second path, the image is 
reflected by mirror 160 to mirror 162 and through a 
second filter 166 to be imaged by camera 170. The 
filters 164 and 166 are narrow bandpass filters 
substantially blocking all hght frequencies outside 
their pass band. The images from cameras 168 and 
170 are therefore essentially monochromatic images 
of the field under study on the slide 14. The first filter 
element 1 64 con^5rises a red filter that passes on light 
of a narrow bandwidth of wavelengths near 620±10 
nanometers. The second filter element 156 is a blue 
filter that passes light of a narrow bandwidth of 
wavelengths near 480±10 nanometers. 

Each television camera 168, 170 converts the 
monochromatic optical images point by point into a 
scarmed electronic signal representing the optical 
intensity of points in the image. The output of the 
cameras 168 and 170, which is formatted as a 
standard NTSC analog video signal, is applied to an 
analog to digital converter of a pair of image 
processing interfaces 21, 23. Each image processing 
interface 21, 23 takes in the analog signal from each 
camera 168, 170, respectively, and converts the 
image signal to a digitized signal that is captured and 
stored by the system control 22. Because of the 
continuous scanning, a real time image of the area 
that the optics 16 are focused on is provided by the 
image display 37. With the dual camera arrangement 
either a red color image or blue color image is 
available simultaneously to the system control 22. In 
general, each monochromatic digital image is stored 
asa512x512 array of pixels where each pixel has a 
measured light intensity of 0-255 (8 bits). 

Because the viewing optics 24 of the microscope 
15 are located on the other side of the image splitter 
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25, this parfocal arrangement allows the same image 
seen in the viewing optics 24 to be displayed on the 
image display 37, 

This feature allows the positioning of the 
platform 51 by the manual X, Y adjustment of 
positioning means. 1 2 and 1 7 until the operator views 
a field of interest on the slide 14. At that time, the 
computer enhanced digitized image of the selected 
field is displayed on the image display 37 for further 
analysis. An X position sensor 26 and a Y position 
sensor 27 generate position signals to a position 
interface 34 which digitizes these signals to provide 
the apparatus 11 with an accurate coordinate 
representation of the field in view. 

Both of the displays 37 and 62 are controlled by 
the system control 22 through standard video monitor 
interface circuits 39 and 61, respectively. Similarly, 
the keyboard 36 and the printer 38 communicate with 
the system control 22 through conventional interface 
circuits 35 and 41, respectively. In addition, the 
system control 22 controls a random access memory 
73 and other bulk memory storage in the form of 
either floppy or hard disk drive 75 through a memory 
control interface 7 1 , 

All of the interface circuits 21, 23, 34, 35, 39, 41, 
61, and 71 can be selectively embodied on printed 
circuit boards which are mounted in the backplane or 
card connector of a conventional personal computer 
forming the system control. Preferably, the personal 
computer can be one manufactured by the IBM 
Corporation having a model designation AT, or those 
compatible therewith. Such system control 22 can be 
run under a disk operating system such as PC DOS, 
version 3.1 or later. The system software for the 
image analysis is called as an application program 
from the disk drive 75, and could for example, be 
supplied on a floppy disk 77. The system software is 
read from disk 77 and loaded into RAM 73. After 
loading, program control is transferred to the system 
software from the operating system to regulate the 
various hardware elements of apparatus 11 
previously set forth in a known manner. 

The image analysis system 13 operates under an 
interactive program control by providing a number of 
instruction screens or images on the instruction 
monitor 62 to assist the operator in the quantification 
of nuclear DNA found in one or several cell 
subpopulations displayed on image monitor 37. 
Through interactive responses by the operator and 
menu selections on different instruction screens, the 
basic system functions of the image analysis are 
performed. 

The system functions are more fully illustrated in 
Fig. 4 where software control logic functions for the 
hardware in block 80 are shown communicating with 
software analysis and measuring functions of the 



system software in blocks 82-96. Software is 
included in the system to perform an initialization 
and an interfacing of the operating system functions 
and overall control of the apparatus 1 1 by instrument 
control logic. A screen handler for the instruction 
screens and the video display of the digital images of 
the specimen is performed for both of the monitors 
37, and 62 by image and instruction monitor control 
logic. The memory and disk storage functions are 
handled in the software by memory control logic. 
Input and output for the interactive responses and 
reports are handled by the printer and keyboard 
control logic. Further, data from the cameras 168, 
170 and from the position sensors 26, 27 are handled 
by image acquisition control logic and position 
acquisition control logic, respectively. 

The control logic of the software forms an 
operating shell which is used by the analysis and 
measuring functions in blocks 82-96 to control the 
hardware of apparatus 1 1 to perform the particular 
function needed. The system provides a patient 
labeling function 82 to identify the particular tissue 
samples which are under study. Light calibration and 
position calibration functions 84 and 86, respectively, 
are used to determine a correct reference optical 
density for a particular field and the location of that 
particular field with respect to an equivalent sample 
source. A control cell calibration function 88 
provides a datum for the compensation of different 
background stainings and DNA index measurement 
calibration. A union formation function 90 allows the 
operator to choose a reference level against which the 
gray scale values of an image are compared for either 
the red image or the blue image. A selected cell 
marking function 91 provides for the marking of 
those cells identified by the cytoplasm optical 
enhancement in the acquired data function. The cell 
data acquisition function 92 provides for the storage 
of the gray scale values of the measurements a 
specimen image. A cell classification function 93 
allows the operator to classify the acquired cells, 
taking into account those marked cells, into different 
categories, and a cell analysis function provides 
different statistical analyses of the categorized data. 
A utilities function 94 provides the needed auxiliary 
type programs for assisting in the primary functions 
of the image analysis. A report generation function 
96 is used for hardcopy production of analyzed and 
con^iled data from the system on the printer 38, 

The support on which a specimen is viewed 
preferably is a transparent glass slide 14 as illustrated 
in Figs. 5 and 6, Glass slides of a rectangular shape 
come in standardized sizes such as 1" by 3" and such 
can be used with the following modifications. The 
slide 14 is partitioned into two sections where in a 
first control section 56 are located control cell objects 
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40. In a second section, specimen section 58, there 
are located specimen cell objects 52 to be measured 
for their content of DNA. The slide 14 further 
includes a border 54 around the control section 56 for 
rapid identification of that section. Further, on some 
appropriate location of the slide 14 is placed a 
identifying mark 53. The mark 53, illustrated as a 
cross in Fig. 4, is used as a landmark for identifying 
the equivalent source for fields on the slide. Because 
the apparatus 1 1 may be used in various offices such 
as pathology offices having persons of varying 
degrees of skill and knowledge about image analysis, 
the microscope light source 17 may be variously 
adjusted by different operators such that the 
background may have a different light intensity not 
only from machine to machine but also at different 
times depending on the age and nature of the hmp 
doing the illumination. When the cell objects are 
DNA nucleus, the stained nuclei appear darker and 
have high darker gray levels than the cells that have 
fewer or no DNA content. The particular light 
intensity level is desired to be known in an accurate 
and real manner. 

Hence, it is important that there be a calibration 
of the light intensity to eliminate errors which might 
be introduced if differences in light intensity levels 
are not accounted for. 

A further problem with widespread usage of 
equipment of the foregoing kind is the Feulgen 
staining factor by which is meant that the user may 
be applying either a heavy amount or a light amount 
of the Thionin stain. This will result in a variation of 
the gray level being viewed through microscope 15 
and by the cameras 168, 170 that is then analyzed as 
to the particular DNA content. Thus, there is a need 
that the apparatus 11 be calibrated to eliminate 
differences because of the staining factor so as to 
provide a correct estimate of the actual amount of 
DNA, being analyzed. 

In accordance with the present invention, a 
calibration material 40 is provided on the slide that, 
when viewed by the operator under a calibration step 
of the system software allows the operator to adjust 
and to calibrate the apparatus prior to the measuring 
and analyzing of specimen cell objects on the slide 
14. 

In the embodiment of the invention there are 
provided two different materials on the slide 14 with 
the furst being the control cell objects 40 which are 
stained simultaneously with the staining of the 
specimen cell objects 12. The simultaneous staining 
permits the analysis of the control cell objects to be 
compared to a predetermined stored reference light 
intensity, gray level, or optical density which the 
control cell objects 40 have after staining. If the cell 
objects are stained either too lightly or too heavily, 



the amount of understaining or overstaining can be 
quantitatively analyzed and adjusted for as will be 
described hereinafter. 

The control cell objects 40 are, in this illustrated 
embodiment of the invention, rat liver cells of a 
known size and shape, and DNA content. The control 
cell objects 40 may be other types of cells having 
dark centers or nuclei which stain well, such as 
chicken blood cells or trout cells. On the other hand, 
the cell objects 40 may be artificial objects printed on 
the slide to have a cell shape. Furthermore, as above 
explained, the cell objects 40 may be conventional 
plastic beads of a predetermined size which will react 
with a particular fluorescent stain or enzyme stain 
when treated simultaneously with control cell objects 
such as monoclonal antibodies used in the specimen 
area 58 of the slide. The reference cell objects will 
vary from test to test and the present invention is not 
limited to any particular test or cell objects. 

A pathologist will take a slide such as shown in 
Figs. 5 and 6 having premounted thereon the control 
cell objects 40, and add thereto the specimen cell 
objects 52 that are, in this instance, cells from a 
needle aspirate of tumor tissue or monolayer of blood 
cells or other cells, at the area 58 on the slide. The 
pathologist will then stain or otherwise treat 
simultaneously the control cell objects 40 and the 
specimen cell objects 52 for image enhancement. 

A kit is provided with the apparatus 11 that 
contains the slide 14 with the control cell objects 40 
thereon, and reagents that are needed for the dual 
staining technique. For the alkaline phosphatase 
staining technique the kit contains bottles of a 
primary antibody reagent, a biotinalated secondary 
antibody reagent, an Avidin-Biotin, alkaline 
phosphatase reagent, and a chromagen substrate 
(preferably fast red). For the Feulgen staining 
technique the kit contains bottles of Thionin reagent 
solution, and rinse reagent. 

To prepare a slide 14 for analysis, the following 
process is used. The slide 14 having control cells in 
section 54 and specimen cells in section 58 is first 
stained with the alkaline phosphatase technique to 
optically enhance a specific cytoplasmic antigen The 
immunohistochemical staining begins with a 
nonfixed specimen on slide 14 which is initially 
lightly fixated at 40*C in acetone for 20 minutes. The 
slide is then rinsed twice in a phosphate buffered 
saline solution for five minutes (each rinse) without 
allowing the slide to dry. The slide 14 is then 
incubated for 15 minutes at 37°C in a moist 
environment with a solution of 2 ml to which has 
been added 10 drops of normal horse serum. This 
step prevents much of the nonspecific binding of the 
antibody to sites of the cell objects. 
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After evaporating the excess of the normal horse 
serum solution off the slide 14, it is incubated 15 
minutes at 37'C in a moist environment with the 
primary antibody binding to the antigen in the 
cytoplasm of the cell objects. 

The slide 14 is again twice rinsed in a phosphate 
buffered saline solution for 3 minutes (each rinse) 
without allowing the slide to dry. Next, the slide is 
incubated for 15 minutes at 37°C in a moist 
environment with biotinalated bridging antibody 
solution. The dilution of the antibody solution is 
1 :400. The slide is again twice rinsed in a phosphate 
buffer saline solution for 3 minutes (each rinse). 

Thereafter, for development and magnification 
of Avidin-Biotin, alkaline phosphatase solution is 
incubated with the slide 14 for 15 minutes at 37*C in 
a moist environment. Solutions of A-B complex and 
alkaline phosphatase solution are available from the 
Vector Corporation of Burlingame, California, as 
solution A, and solution B of kit number SK-5100. 50 
microliters of solution A and 50 microliters of 
solution B is mixed with 5 milliliters of a 1% bovine 
serum albumin/phosphate buffered physiological 
saline solution to form the development solution. 

The slide is again rinsed twice in a phosphate 
buffered physiological saline solution for 3 minutes 
(each rinse). A chromogen substrate is then added to 
color the developed precipitate. 

Preferably, the substrate is red dye, fast red, from 
the same kit as above which contains dye solutions 1, 
2, and 3. Two drops each of solutions 1, 2, and 3 are 
added to 5 milliliters of 100 mM TnS with a pH of 
8.2. This solution is incubated with the slide for 15 
minutes at 37°C in a moist environment. The final 
step in the cytoplasm development is to rinse the 
slide for 1 minute in distilled water. 

The slide 14 is then stained with the Feulgen 
technique using Thionin to optically enhance the 
nuclear DNA of each cell. The slide 14 is fixed in 
10% by volume buffered formalin, adjusted to a pH 
in the range of from about 7.2 to 7.5, for 10 minutes 
at room temperature. The nuclear DNA of the cell 
objects is then hydrolyzed by treating the slide 14 for 
about 60 to 75 minutes in 5N hydrochloric acid. The 
staining process is accomplished on the slide by 
transferring it to a Thionin solution for about a one- 
hour period. Afterward, the slide 14 is rinsed in a 
three state process of rinse solution. The slide is 
placed in a first stage of rinse solution for 30 seconds, 
transferred to a second stage of rinse solution for 
about 5 minutes, and then treated in a third stage of 
rinse solution for about 10 minutes. The slide is 
subsequently washed for about 5 minutes in running 
distilled water, and thereafter washed with acid 
alcohol (0.37% hydrochloric acid, 70% ethanol) for 5 
minutes. The slide 14 is then dehydrated in absolute 



ethanol for about 5 minutes to prepare it for mounting 
with a coverslip. Finally, the slide is cleared in xylene 
for about 5 minutes before being mounted with a 
synthetic resin and coverslip. 

In Fig, 7 there is shown a representative drawing 
of the marking and amplification of a particular 
antigen site 180 labeled AR. The site is an antigenic 
against a primary antibody 182 that binds thereto. In 
the preferred embodiment, a bridging antibody 184 
against the primary antibody is used to bind to the 
primary antibody and has affixed a Biotin molecule 
188. To the bound primary and bridging antibodies is 
added Avidin-Biotin complex including an Avidin 
molecule 186 and three Biotin molecules. These 
Biotin molecules 188 are conjugated with molecules 
of alkaline phosphatase AP enzyme 190. The fourth 
Biotin molecule site is open to binding die complex 
to die bridging antibody 184. The site, when a dye 
such as fast red molecules 1 92 in solution is added to 
this mixture, the alkaline phosphatase reacts with the 
dye molecules to produce insoluble fast red 
molecules 194 that mark the antigen site. While the 
Avidin-Biotin complex is exemplary and preferred, 
any number of different marking techniques can be 
used. Alternatively, a bridging or primary antibody 
that is anti-alkaline phosphatase can be used, and 
then an^lified by fast red dye in the manner 
previously described. A dual filtering method is 
thereafter applied to distinguish the areas (cytoplasm) 
stained by the red chromagen and the areas (DNA) 
stained by the blue Thionin These images, one by the 
red filter and the other by the blue filter, are used to 
separate the DNA stained areas from the cytoplasm 
areas containing the specific antigen, and to separate 
both of these areas from other cell or field objects. 

The results and desirability of this dual filtering 
of a stained cell image are more fiilly illustrated in 
Fig. 8. The percentage of light transmitted through 
the nuclei stained with Thionin dye is shown in the 
curve A as a ftinction of the wavelength of light. The 
light transmission rate for fast red dye is shown in 
curve B as a ftmction of the wavelength of light. The 
bandwidth of wavelengths of light passed by the blue 
filter is illustrated in band C while the bandwidth of 
wavelengths of hght passed by the red filter is 
illustrated in band D. When a true color image of a 
cell population or specimen is filtered with the blue 
filter 166, substantially all of the areas stained with 
the fast red dye will be invisible and substantially all 
the areas stained with Thionin dye visible. This is 
because the Thionin curve A has a relatively 
nontransmissive peak near this wavelength band (480 
nm) while the fast red curve B is relatively 
transmissive in this band. Thus, in this manner the 
areas with Feulgen stain can be separated from the 
cytoplasmic areas. At the other extreme of the graph, 
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the band D of the red filter 164 is positioned at a 
place where just the opposite occurs. The Thionin 
curve A is relatively transmissive in this bandwidth 
while the fast red curve B is relatively 
nontransmissive. Thus, the cytoplasmic areas 
containing the fast red dye can be identified without a 
problem. 

Because of the opposite relative differences in 
light transmission between the two stains in the two 
filtered bandwidths, the Thionin stained area is 
enhanced during one filtering relative to other areas 
of the cell, and the fast red stained areas are enhanced 
relative to other areas of the cell during the second 
filtering. While the implementation shows a 
convenient and advantageous method for 
discriminating between the two areas having separate 
staining, it is recognized that there are various other 
staining or optical enhancement methods and filtering 
methods which can be used to optically enhance one 
particular area or feature over another cell area. 

The system software for DNA analysis can now 
determine the mass of the cellular DNA by obtaining 
the optical density of the specimen cells from the 
Thionin stain via the instrument 11. In general, the 
mass of the DNA of a stained cell object can be 
obtained from its optical density by utilizing the 
Beer-Lambert Law, which is well known in the art of 
microspectrophotometry. The equation states; 

aeOD 

M= 

where M = mass of the object in picograms 
a = spot size (^m^) 

EX = extinction coefficient of the stain at 

wavelength X (jamVpg) 
OD=optical density of each spot (dimensionless) 

The instrument uses this law to find the overall 
distribution of a number of cells or cell objects which 
can then be analyzed according to a statistical basis, 
histogram, or other analytical format as will be 
discussed hereinafter. The spot size a is determined 
by the number of pixels measured by the camera 18. 
The optical density for each pixel is calibrated by 
adjusting the light level, focus, and reading a 
reference optical density from the measurement area 
on the slide. This measurement allows the conversion 
of the measured light levels for each pixel into an 
optical density, a dimensionless quantity the 
conversion of the measured light levels for each pixel 
into an optical density, a dimensionless quantity. 



Translator's note: The repetition in this sentence 
represents a typo. 



A measurement for the extinction coefficient is 
accomplished by measuring the optical density for a 
plurality of the control cells 40 to determine a peak 
for the distribution in relative mass units. Because the 
peak DNA content is known for the control cell 
distribution, the cells in the measurement field can be 
measured using the relative OD units and then 
converted directly into picograms by using the 
control cell measurement. For example, if the control 
cells are known to contain pg of DNA (rat liver cells) 
and a group of calibration cells show a peak 
distribution of 11, 000 relative OD units then a normal 
group of human cells (with a known DNA content of 
7.18 pg) would exhibit a peak in their distribution at 
approximately 13,250 relative OD units. Further, any 
other relative OD unit measurement can be converted 
directly into picograms by determining and using the 
extinction coefficient found from the group of 
measurement cells. 

The method of the invention is combined with 
this technique as will now be more fully described 
with respect to Figs. 9-12. Figs. 9-11 are pictorial 
representations of the true color image of a field of a 
slide 14 (Fig. 9), an image filtered with the red filter 
(Fig. 10), and an image filtered with die blue filter 
(Fig. 11). Fig. 12 is a flow chart of the steps in the 
method to produce quantification of nuclear DNA. 

In Fig. 9 there is illustrated several cells of a 
subpopulation from one of the fields of the 
microscope slide 14. The subpopulation contains 
different types of cells, wherein specific cells 202, 
204 have been optically enhanced by the alkaline 
phosphatase staining. All the cells 200, 202, 204, 
206, and 210 have had the DNA in their nuclei 
optically enhanced by Feulgen staining with Thionin 
dye. 

When the image is filtered with the red filter in 
Fig. 10, only those areas that contain the fast red dye 
are visible. These are the cytoplasmic areas 212, 214 
of cells 202, 204 respectively which have been 
optically enhanced because they contain a specific 
antigen which binds the monoclonal antibody of the 
alkaline phosphatase staining. This type of cells 202, 
204 are different from the cell types 200, 206, 208, 
and 210, which are invisible in this image. Further, 
the nuclei of all cells 200, 202, 204, 206, 208, and 
210 can be made invisible in the background because 
of the optical separation of the Thionin dye and fast 
red dye. 

In Fig. 1 1 there is illustrated the result from the 
blue filter, where all the nuclei 216, 218, 220, 222, 
224, and 226 from the cell population are visible. The 
image filtered with the blue filter produces an 
exclusion of those cytoplasmic areas which are not 
nuclear stained (clearer than stained parts), and which 
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are optically different (fast red stained) even if 
stained. 

The areas stained above the thresholds set for 
each filtered image can then be combined by 
overlaying the DNA image on the cytoplasmic image 
digitally to present on the monitor a clear image of 
the DNA nuclear areas for typing and analysis where 
certain cells 202, 204 are marked clearly as to type by 
an identifying cytoplasmic ring or crescent on the 
nucleus Fig. 13. The DNA analysis then proceeds by 
the interactive classification of each cell in the image 
displayed on the image monitor 37. The specifically 
marked cells 202, 204 can be included in any class, 
excluded from any class, or classified entirely 
separately from any other class. Moreover, it is likely 
possible that different optical enhancements and 
filterings will give rise to different typings and 
increase the sensitivity of the classification process. 

The method of measuring and analysis of nuclear 
DNA using the marking technique of the invention is 
more fully illustrated in Fig. 12. In a first step, in 
block 250, a slide 14 containing control cell objects 
and specimen cell objects is stained with the alkaline 
phosphatase technique using fast red dye. The 
monoclonal antibody is specific against a 
cytoplasmic antigen, for example, Leukocyte 
Common Antigens or Cytokeratins. The next step in 
the process is to stain the slide 14 with the Feulgen 
process using Thionin in block 252. After moimting, 
the slide 14 is placed on the platform 51 of the 
instrument 11 and the operator positions the slide 
such that a clear field is shown on the image monitor. 
The light level is then set for the instrument in block 
254. 

The platform is then moved to the control cell 
area where an image of a subpopulation of the control 
cells appears on the monitor 37 in block 256. This 
image is the filtered image (red) showing only the 
Feulgen staining. The amount of staining to 
determine the DNA index, such that mass can be 
determined firom optical density, is found by 
measuring optical density of the control cells in block 
260. Normally, one or more fields of control cells are 
measured to obtain an accurate measurement and this 
step can be repeated by looping through block 264 
and block 262. In block 262, the operator moves the 
platform 51 so that another field of control cells 
comes into view. 

The measurement of the peak of the optical 
density units is converted into" the DNA index and 
stored. The instrument may now be used to measure 
and analyze the DNA of specific cells on the 
specimen section 58 of the slide 14. 

At the end of this step, the instrument platform 
51 is moved to a field where specimen cell objects 
are visible. 



Initially, a cytoplasmic image of the specimen 
field is obtained using the blue filter in block 266 and 
its boundary setting in block 268. Thereafter, a DNA 
image of the specimen field is obtained using the red 
filter in block 270 and its boundary setting in block 
272. These filtered images are real time images of the 
field and are being constantly updated by the image 
acquisition means 18 of the system 11. The apparatus 
1 1 combines the two filtered images in block 274 to 
mark the selected cells on the image monitor 37 
while displaying the DNA nuclear area. The program 
dien proceeds to a classification step in block 276. 
When in the classification mode the image 
acquisition and combination (marking) halts and a 
static image is presented on the image monitor. 

The cells in the image on the monitor 37 are then 
classified as to type by an interactive process with an 
operator where each cell is supported by the 
apparatus, and the operator in response to the 
identification selects a classification for it using the 
nuclear morphology and the cytoplasmic markings of 
the combined image. The classified cells are then 
measiu*ed for DNA content in block 278 and the 
results of the measurements displayed in block 280. 
The display can be in various forms and statistical 
analyses of the different classifications or 
combinations of classifications. 

The measurement step can include more than the 
cells in one field by conducting a loop of block 282 
and block 284. The operator moves the platform 51 
of the apparatus 11 to another use field in block 284 
and the marking and imaging steps proceed as 
previously described. The data accumulated in the 
measuring step for the new cell population is added 
to that developed for the previous cell population(s). 
The display step in block 280 can be delayed until a 
significant amount of data is accumulated or a 
display of each iteration provided at the option of the 
operator. The operator further has the option to 
bypass setting the cytoplasm boundary and DNA 
boundary once they have first been set for a specimen 
image. 

The system program for DNA quantification is, 
in general, a menu driven program that allows the 
operator to interactively communicate with the image 
analysis system 13 to produce the quantification of 
nuclear DNA by image analysis. The system program 
displays a plurality of images or instruction screens 
on the instruction monitor 62 which include menus 
fi'om which to select the various functions needed for 
performing a quantitative nuclear DNA assay. Fig. 17 
illustrates the screen architecture of the system and 
the paths that the system takes between screens. 
Examples of two of the system screens, the calibrate 
screen A 14 and the analysis screen A 1 6, which 
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appear on the instruction monitor 62 are illustrated in 
Figs. 15, and 16, respectively. 

Returning to the reference numerals in Fig. 17, 
the system program may be run by calling it as an 
application program of the operating system A 10. 

Selection of the system program by the operating 
system A 10 produces the main screen A 12 on the 
monitor 62. From the main screen A 12 the operator 
can select a measurement screen A 14, an analysis 
screen A 16, or exit back to the operating system A 10. 
While displaying the calibrate screen A 14, the 
instrument can be calibrated to provide the 
background or reference light settings which will be 
used in the measurement of the assay. Once the light 
calibration is complete the operator can select an 
analysis screen A16 used to measure and classify the 
cell objects of the assay technique. 

One of the options in the analysis screen A 16 is 
to adjust the blue boundary that assists in forming the 
nuclear areas. 

Another of the options is to adjust the red 
boundary which produces the adjust red boundary 
screen A20. Once the nuclear and cytoplasmic areas 
have been connected by the screens A 18, A20, the 
operator can select the analysis screen A16 to 
actually do cell measurement, classification and to 
generate reports. Exits from the adjust blue boundary 
screen A18 and from the adjust red boundary screen 
A20 are to the analysis screen A 16, which can then 
exit back to the main screen A 12. In this manner, an 
advantageous screen architecture is formed which 
can be easily used and understood by the operator. 
This screen structure facilitates the interactive 
measurement of the nuclear DNA of the particular 
cell subpopulation under study. The instruction 
screens provide an interactive use of the digital 
imaging system that combines the power of the 
system software and hardware with the judgment and 
knowledge of the operator. The screen structure 
automates the assay task of nuclear DNA 
quantification and permits the operator to selectively 
choose the input data and control the process to a 
considerable degree. 

Each screen A12-A20 contains a menu of the 
functions permitted for use while that particular 
screen is being displayed on the instruction monitor 
62. The function that the system is to currently 
execute in a particular menu is chosen by the operator 
with a cursor movement method using the standard 
cursor control keys of keyboard 36. While a 
particular screen is being shown on the monitor, the 
cursor movement keys are operable to position, the 
cursor next to a particular function listed on the menu 
of that screen. While the cursor highlights the 
function by its position, the operator may select the 
function for execution by pressing the enter key. 



The main screen 12 displays the main menu A22 
illustrated in Fig. 18. The main menu A22 provides 
five choices which include (1) a specimen function 
A24, (2) a label function A24, (3) a set light function 
A 30, (4) a calibrate function A32, aiid (5) an exit 
function A28. 

The calibrate screen A34 displays the calibrate 
menu A34 illustrated in Fig. 19. The calibrate menu 
A34 provides seven choices which include (1) a 
check light function A36, (2) a set XY function A38, 
(3) a focus function A40, (4) a measure function A42, 
(5) an XY-1 function A44, (6) an analyze function 
A46, and (7) a main function A48. 

The adjust blue boundary screen A18 displays 
the adjust blue boundary menu A50 illustrated in Fig. 
20. The adjust blue boundary menu A50 provides 
five choices which include (1) a set step size-B 
function A52, (2) a toggle-B function A54, (3) an 
increase-B function A56, (4) a decrease-B function 
A58, and (5) an exit function A60. 

The adjust red boundary screen A20 displays the 
adjust red boundary menu A62 illustrated in Fig. 21. 
The adjust red boundary menu A62 provides five 
choices which include (1) a set step size-R function 
A64, (2) a toggle-R function A68, (3) an increase-R 
function A70, (4) a decrease-R function A66, and (5) 
an exit function A72. 

The analysis screen A16 displays the analysis 
menu A74 illustrated in Fig. 22, The analysis menu 
A74 provides sixteen choices which include (1) a 
delete type function A76, (2) a classify function A78, 
(3) a focus-2 function A80, (4) a CK-light function 
A82, (5) a select 2nd function A84, (6) an area 1-2 
function Y selection base A86, (7) a display XY 
fiinction A88, (8) a clear ftmction A90, (9) a XY-2 
function A92, (10) a report preparation function A94, 
(11) a standard function A96, (12) a boundary-B 
fiinction A98, (13) a boundary-R function A 100, (14) 
a main function A102, (15) a mask function A104, 
and (16) a disappear function A 106, The label 
function allows a user to enter information regarding 
patient identification, accession number, and DNA 
conversion number. The DNA conversion number is 
the niunber that the first and second peak masses are 
divided by to get the first and second peak indexes. 
Initially, the number is set to a standard 7.18 
picograms/cell for normal human cells. However, the 
apparatus may be used to measure non-human cells 
and the index may be changed to that desired. The 
DNA index must be greater than or equal to 1 .0 and 
less than or equal to 99.99, If the conversion number 
is not within that range, the user is not allowed to 
select the analyze option in either the main or the 
calibration screens. 
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The three arrangements of information entered 
during the label function will appear on every screen 
except the X, Y field coordinate screen. 

The label operation is exited by pressing either 
the enter or escape key. Pressing the enter key will 
save any changes that were made to the three 
arrangements of information. Pressing the escape key 
will ignore any changes that were made to the three 
arrangements. The information stored during the 
label function will not be saved when the program is 
exited. 

Selecting the measurement function will cause a 
change of the display on instruction monitor 62 from 
the main screen to the calibration screen illustrated in 
Fig, 15. The calibration screen whose options are 
shown in Fig. 19 are those necessary to perform 
measurement of the instrument for optical density 
and for staining factor on the control cells. A 
measurement of the apparatus 11 is to be performed 
every time a new slide is selected to normalize the 
light level and staining factor. 

Selecting the analyze function will cause a 
change of the display from the main screen on 
monitor 62 to the analysis screen as illustrated in Fig. 
16. The analysis screen contains the menu for the 
functions that are necessary to perform data 
acquisition and DNA measurements on the specimen 
cells. These functions are more fully set forth in Fig. 
22. Three criteria must be met in order to select the 
analyze function. First, the set light function in the 
calibration screen must have been successfully 
performed at least once. The set light function is 
successful when the current image is blank and the 
light level is between 129 and 131. Secondly, the 
calibration control cell count must be between 50 and 
512. Finally, the DNA conversion number must be 
greater than or equal to 0.1 and less than or equal to 
99.99. 

The exit function allows the user to terminate the 
operation of the program from the main screen. 
Pressing the escape key is the same as selecting the 
exit function. When the exit operation is specified, 
either by selecting exit or pressing escape, the user 
will be asked to confirm his command to exit. To 
accept the confirmation, the user selects the yes key. 
To reject the confirmation, he selects the no key or 
presses the escape key. 

The options of the calibration menu will now be 
more fully explained. The set X, Y of function A3 8 
provides the setting of the origin for the slide X, Y 
coordinate system. This function sets the current 
image or field location as the origin by zeroing a pair 
of location registers in the software. Generally, the 
microscope platform 51 is moved until a easily 
recognized landmark is visible, such as cross 53. This 
landmark is then used to rezero the coordinate system 



to provide a means of relocating previously measured 
fields. The set X, Y function is used every time a new 
slide is selected. If the set X, Y function has not been 
executed, then the X, Y functions of the calibration 
and analysis screens and the functions in the X, Y 
field coordinates screen will not work properly. The 
set X, Y function can only be used when the 
calibration control cell count is equal to zero. If the 
microscope platform 5 1 is being moved when the set 
X, Y operation is in execution, then the coordinate 
origin will be in error. The program provides a 
message on the screen to notify the operator when the 
set X, Y operation is successful. 

In response to the function not being successful, 
the operator merely reselects set X, Y from the menu 
and attempts the function again. 

The measure function A42 is used to perform the 
control cell or control object measurement for 
normalizing the staining factor. When the measure 
function is selected, the camera image acquisition 
will stop and a cursor 170 on the measurement screen 
will move to the words "measure operations'' in Fig. 
15. When the cursor 170 is at this location, the user 
can specify measiu*e operations by activating the 
numeric lock key. An identifier such as a magenta 
colored box will be placed around an identified cell 
object. By using a number of key operations, the 
operator can perform an interactive selection and 
rejection process that will be more fully explained 
hereinafter. 

During control cell calibration, the operator 
moves the microscope stage by turning the 
conventional X and Y knobs 11 and 17 (Fig. 1) to 
shift the control cell object into view on the image 
monitor 37. When an individual cell object 40 is 
within a box or identifier border 75, the operator 
presses a key on the keyboard 36 to enter 
measurement of the summed optical density for that 
control cell object. After a suitable number of control 
cell objects have been analyzed, the operator will be 
provided with a histogram such as shown in Fig. 15 
on the instruction monitor 62, which shows the 
operator the control cell object ploidy distribution as 
having a relative quantity of DNA. Internally within 
the system control 22, the summed relative optical 
density values actually measured for the control cell 
objects are compared to a predetermined standard or 
reference amount of DNA that the control cells are 
known to have. The actual summed optical density 
found by the operator is divided into the stored 
reference DNA value to provide a factor by which to 
adjust the extinction coefficient for deviations in the 
stain from a perfect staining. 

The XY-1 function A44 when selected displays 
the X, Y coordinates of the current image or field on 
the calibration screen on image monitor 37. The 
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coordinates will be continuously displayed until the 
user presses a key (except CTRL, ALT, or SHFT). 
Thus, if the same origin for the slide 14 was set, the 
operator can, by positioning the platform 51 and 
watching the coordinates change, find the same 
image which was previously recorded. The set X, Y 
function A36 must have been successfully performed 
previously in order for the X, Y function to be 
selected. 

The FOCUS- 1 function A40 provides color 
enhancement to the image so that the user can 
perform more precise focusing of the image. The 
system control 22 automatically provides different 
colors for gradations in gray level in the image. 

The operator then adjusts the focusing means of 
the microscope 15 until the object being focused on, 
for example an edge of the border 54, shows a clear 
color demarcation. This is an indication that the two 
separate levels or gray scale of the edge are in focus. 
This is much more difficult without color because the 
two gray levels may be close together and 
indiscernible without the color enhancement. The set 
light function A30 must have been successfully 
performed at least once in order to select the focus 
function. To restore the image to its original color, 
the focus function is selected a second time. If the 
color enhanced image is present when the user selects 
the measure function, the image will automatically be 
returned to its original color. 

Selecting the analyze function will change the 
display from the calibration screen to the analysis 
screen. The analysis screen displays a menu of 
functions shown in Fig. 22 that are necessary to 
perform the DNA measurements on the cellular 
material. Three criteria must be met in order to select 
the analyzed function. First, the set light function in 
the calibration screen must have been successfully 
performed at least once. Secondly, the calibration 
control cell count must be between 20 and 512. The 
analyze function in the calibration menu works the 
same way as the analyze function in the main menu. 

The analyze function options in the analysis 
menu are shown in Fig. 22. The check light-2 
function A82 calculates the light level of the current 
image. The light level value is displayed on the 
analysis screen by the words "light level" in Fig. 16. 

The select-2nd function A84 allows the user to 
select the second peak on the histogram displayed on 
the analysis screen. The mass, DNA index, and the 
area of the second peak are displayed on the screen 
under the words "second peak." The select-2nd 
function cannot be selected when the shown cell 
coimt is equal to zero. The shown cell count is 
displayed by the word "shown." After the select-2nd 
function has been selected, the cursor will move to a 
set of arrows and the current second peak location on 



the histogram will be highlighted in yellow. Initially 
die right most histogram data location is chosen as 
the second peak. Selecting the left arrow moves the 
second peak location to the left and the user selects 
the right arrow to move the second peak location to 
the right. Every time an arrow is selected, the current 
peak data on the screen will be updated. 

Below the histograms horizontal axis, one of 
three symbols will appear underneath the second 
peak location. A "less than" symbol will appear if the 
second peak lies in area one. A "greater than" symbol 
will appear if the second peak lies in area two. 

An up anow symbol will appear if the second 
peak lies in neither area one nor area two. The reason 
for die three symbols is so that the second peak 
location can be identified after the select-2nd 
operation is exited. The vertical yellow line 
disappears once the select-2nd function is exited. The 
specimen person"* presses the ESC key to exit the 
select second operation. The second peak data will 
also be automatically cleared when one of the 
following analysis screen functions is selected: clear, 
report, scale, or main. 

The classify function A78 allows the user to 
classify the cells or objects in the current image. 
After the classify function has been selected, the user 
will be asked to confirm the operation. To accept the 
confirmation, the user will select the yes key, and to 
reject the confirmation, the user will select the no key 
or press the ESC key. If the classification function is 
confirmed, camera acquisition stops and the cursor 
will move by the words "classify operation." When 
the cursor is at this location, the user can specify the 
classify operations by activating the numeric lock to 
enable these functions. As was the case in the 
measure function, a magenta colored box will be 
placed around a current cell and the operations allow 
the user to move this cell identifier through the image 
to identify and classify the cells therein. 

The display X, Y function ASS will change the 
display from the analysis screen to the X, Y field 
coordinates screen. The X, Y field coordinate screen 
will display the X, Y coordinates of the first 512 
images that have been classified and stored. Also, the 
screen contains the functions that allow the sorting of 
the image fields by coordinates. The set X, Y 
function in the calibration screen must have been 
successfully performed before the display X, Y 
function is selected. 

The X, Y field coordinate screen has several 
functions. One of the functions, "nearest" sorts the X, 
Y coordinates according to the distance from the 
current X, Y field position. The X function will sort 
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the X, Y coordinates according to the X coordinate 
value. If there is a tie, then the Y coordinate value 
will determine the sort order Similarly the Y 
function will sort the X, Y coordinates according to 
the Y coordinate value. If there is a tie, then X 
coordinate value will determine the sort order. The 
"field#" function will sort the X, Y coordinates 
according to the coordinates field number. The field 
number is the order in which the images were 
classified. 

The page up function allows the user to display 
the previous page of X, Y coordinates, if any, and the 
page down function allows the use to display the next 
page of X, Y coordinates, if any. The exit function 
changes the display from the X, Y field coordinate 
screen to the analysis screen. Pressing the escape key 
is the same as selecting the exit function. 

Selecting the X, Y function displays the X, Y 
coordinates of the current field. The coordinates will 
be continuously displayed until the user presses a key 
(except CTRL, ALT, and shift). The set X, Y 
function in the calibration screen must have 
successfully been performed before the X, Y function 
is selected. The X, Y function in the X, Y field 
coordinate screen works the same way as the X, Y 
function in the calibration and analysis screens. 

The clear-2 function A90 will clear all analysis 
related areas of data. After the clear function has 
been selected, the user will be asked to confirm the 
clear operation. To accept the confirmation, die user 
selects the yes key, or to reject the confirmation, the 
user will select the no key or press the ESC key. 

The focus-2 function A80 provides color 
enhancement to the image so that the user can 
perform more precise focusing of the image. The 
focus-2 function in the analysis screen works the 
same way as the focus function in the calibration 
screen previously described. 

The area 1-2 function A86 allows the user to 
specify two areas in the histogram displayed in the 
analysis^ screen. The purpose of this ftmction is to 
identify the cell counts in certain areas in the 
histogram The area 1-2 function cannot be selected 
when the shown cell count is equal to zero. The cell 
counts are displayed at the lower right portion of the 
screen. After area 1-2 is selected, the cursor will 
move to a row of numbers that is below the 
histograms horizontal axis. The row of numbers 
allows the user to specify the locations of area 1 and 
area 2. The user types a "1" to specify that the current 
histogram position belongs to area 1 . The user types a 
"2" to specify that the position belongs to area 2. 
The user types a "0" to specify the current histogram 
position belongs to neither area 1 or 2. The user is 
allowed to specify an area 1 without an area 2, but 
cannot specify an area 2 without an area 1. When 



both areas are specified, area 1 must be specified to 
the left of area 2. The area must be specified as 
continuous. To exit the area 1-2 function, the user 
presses the enter or ESC keys. If the user presses the 
enter key, area 1 of the histogram will be highlighted 
in green and the area 2 will be highlighted in 
magenta. The area ceil counts will also be displayed. 
Pressing the ESC key will cause the program to 
disregard any of the changes that were made. Area I 
and area 2 data will automatically be cleared when 
one of the following functions is selected: classify, 
clear, report, scale or main. 

The analysis function is more fully described 
with respect to Figs, 13 and 14. The operator will 
select a number of field locations 360, 361, and 362 
in the slide specimen area 58 for analysis. The 
operator will adjust the X and Y knobs 1 1 and 17 for 
the microscope stage 51 to move these fields into 
view on the image monitor 37 a fu:st field of 
specimen cell objects to be analyzed for DNA 
content as well as for cell morphology if desired (Fig. 
13). The program will place a box, for example at 
300, over a particular specimen cell object being 
displayed on the monitor 37 and, then the operator 
will use a key to cause the scanning of the pixels 
(picture elements) of the specimen object to classify 
the cell in a manner similar to that disclosed in U.S. 
Pat. No. 4,453,266 to give summed optical density 
for the cell specimen object i.e., a stained cell 
nucleus, as well as its area, its roundness, and other 
classification information. 

Also, the operator has on the keyboard 36 
several cell classification keys to be manually 
operated and the operator depresses one of the keys 
of a known category such as a type 0 normal cell; a 
type 1 cancer cell; a type 2 cancer cell; a type 3 
cancer cell; and so on. On the monitoring screen 62 
there will be an analysis histogram displaying the 
DNA content of the cells in the field. The operator 
selects a number of cells in each field or area and 
then moves the microscope stage to position a 
number of different fields of specimen cells into view 
and takes and analyses a number of these specimen 
cells until the operator feels he has enough cells for a 
representative sample. 

A histogram, will at this time be displayed on the 
instruction monitor screen 62 which shows the 
number of cells of a particular DNA content and 
shows the DNA content averages for each of the 
reference peaks, such as shown in Fig, 16. By 
depressing a print key, on the keyboard 36 the 
operator may print out the histogram shown in Fig. 
16 on the printer 38. The data for the specimen cells 
is also stored internally within the system control 22 
for later recall and comparison with data of any new 
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specimen from the same patient for analysis relating 
to the progress or regression of a patient. 

The operation of the manual classification for the 
analysis function will be now more fully described 
with respect to Fig. 13 where there is shown a field 
which has been previously stored in the instrument. 
The field contains a number of cell objects that are to 
be classified and measured as to DNA content. When 
the program initially comes into this mode of 
operation, the first object in the field will be 
identified by scanning the pixels of the field in a 
raster like manner until a cell object is recognized. 
Once a cell object is recognized, an identification 
means such as box 300 is drawn around the object. 
This provides a visual identifier for the operator to 
determine which cell object is presently being 
measured. The primary option that an operator has is 
to classify a current object in block A78. He 
accomplishes this by pressing one of the numeric 
keys 0 through 5 which automatically puts the cell 
object of the identifying box 300 into the 
classification selected. If the object identified is 
debris, not an abnormal cell, or not an identifiable 
cell object, the operator can reject the current object 
by selecting a 9 on the keyboard as indicated. 

After the classification or rejection of the object 
in box 300, the operator can move the identification 
box to the next unmeasured object. An operator 
accomplishes this by pressing the keys CTRL/F2 
which causes the program to erase the box 300 and 
search for the next identifiable cell object. This cell 
object is found, and then another identifying box 302 
is drawn around it to indicate to the operator the 
function has been acconq}lished. In this manner, die 
entire group of cell objects can be classified and 
measured or rejected by repeating this process. In this 
manner, the program steps through the analysis 
procedure from object 300 to 302, 304, 306, 308, 
310, and so forth. 

Further, if one of the cell objects to be classified 
does not look like the operator thinks it should and, it 
cannot be put in one of the previous classifications, 
or for some other reason the operator believes he has 
classified a previous object by mistake, then by 
pressing CTRL/Fl, he can move the identifying box 
back to the previously measured object. Af^er 
identifying all cell objects in the particular field being 
displayed, the operator has the option of going to 
another field by manipulating the X, Y positioning 
mechanism to provide more cells for the particular 
analysis. 

When the operator has determined that enough 
cell objects had been analyzed, he may either 
terminate the analysis function by pressing either the 
enter key or escape key. If he terminates the analysis 
function by pressing the enter key, then the data 



assembled from each of the measurements will be 
saved. However, if the analysis function is terminated 
by pressing the ESC key, then the data will not be 
saved. 

The report function A94 allows the user to 
specify which cell classifications are to be included 
in the histogram shown on the screen of the 
instruction monitor 62. After the report function has 
been selected, the cursor can be moved to a option 
list that will allow the operator to specify the cell 
types. The following table specifies which key the 
operator presses in order to select a particular cell 
type. 



CELL TYPE 


KEY 


normal 


Oorn 


1 


1 


2 


2 


3 


3 


4 


4 


lymphocyte 


5 or L 



Any combination of the types for the report data 
is allowed. The program will ignore any other 
characters than those listed in the table. The operator 
exits the report operation by pressing the enter or 
escape key. If the operator presses the enter key, he 
will change the types of cells in the histogram to 
those which were specified. However, if the escape 
key is selected, the program will ignore any changes 
that were made and return normally. The function 
area 1-2 data and the second peak data will 
automatically be cleared most"* the report operation is 
performed. 

The scale function A96 allows the operator to 
change the scale of the horizontal axis of the 
histogram provided on the analysis screen. There are 
three scales to choose from, 0-16, 0-32, and 0-64. If 
the scale function is selected when the current scale is 
0-16, then the new scale will be 0-32. If the scale 
function is selected when the current scale is 0-32, 
then the new scale will be 0-64. Likewise, if the 
scale function is selected when the current scale is 0- 
64, then the new scale will be 0-16. In this function 
the area 1, area 2, and second peak data will 
automatically be cleared when the scale operation is 
performed. 

The boundary functions A98, AlOO will change 
the display on instruction monitor 62 from the 
analysis screen to the respective adjust boundary 
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screen. The adjust boundary screen contains 
functions that are necessary to change the cell 
boundary, i.e., threshold. While addressing the 
boundary screen, camera image acquisition will be 
halted. 

The set step size function of Figs. 20 and 21 
allows the operator to change the amount by which 
the boundary will change when one of the arrow keys 
is selected. The value must be in the range of 0-128. 
Af^er the step size is selected, the cursor will move to 
the location on the screen where the user can type in 
a new step size value. To exit the step size function, 
the enter or escape keys are used. Pressing the enter 
key will save the step size change where pressing the 
escape key will ignore any change that was made. 
Initially, the step size value is equal to one. 

The increase function A56, A 70 will increase the 
cell boundary by the value of the step size and the 
decrease function A58, A66 will decrease the cell 
boundary by the value of the step size. The exit 
functions A60, A72 change the display from the 
adjust boundary screens back to the analysis screen. 
Pressing the escape key is the same as selecting the 
exit function. 

In general, an interactive data collection and 
analysis scheme is used by the apparatus for the 
collection of specific parameters for both the 
calibration cell objects and the specimen cell objects. 
Each field which is selected is displayed on the image 
monitor 37 and either the measure operation of the 
calibration screen or the classify operation of the 
analysis screen is chosen. 

A software flow chart of a subroutine providing 
the interactive operations for the calibrate key 
operations and the analysis key operations in Figs. 15 
and 16 is illustrated in the referenced Bacus 
application. When the operator selects either the 
measure operations or the classify operations, this 
program is called to generate the selection process for 
both the calibration cell objects and the specimen cell 
objects. The program begins by performing a raster 
scan of the stored image pixel by pixel until it finds a 
pixel greater than the threshold value. If no pixel is 
found which is greater than the threshold, a 
determination of whether the scan is complete is 
made. If not, the scan is continued until all pixels in 
the image field are tested. After all pixels have been 
tested, the scan coefficient is reset and the cell object 
array updated. 

At the time an image pixel is determined to be 
greater than the threshold, the program will label the 
object. The operation of labeling will now be more 
particularly described. The individualized cell objects 
in the digitized image are located by a scene analysis 
technique in which the raster scan is made of the 
digitized image to locate any pixel above the critical 



threshold. The technique then performs a four 
neighbor analysis of adjacent pixel elements and 
continues in a recursive manner locating "neighbors 
of the neighbors" which are above the threshold until 
the entire region of a cell object is defmed. This 
technique is preferred to other scene analysis 
techniques, such as local boundary found from a 
gradient image, because it is fool proof in 
distinguishing the true region of a cell, particularly 
those cells having irregular or spiculed projections. 

The four pixels (top, bottom, right side, and left 
side) surrounding the initially located pixel that are 
contiguous therewith are examined sequentially to 
identify the next pixel with a optical density or gray 
level value above the threshold. For instance, if the 
pixel located above the first pixel is not above the 
threshold, it is discarded from the labeling routine. 
The next pixel (right side) in a clockwise direction is 
then examined and may be above the threshold. If so, 
that pixel is then identified and stored in memory 
with the pixel as being a portion of the region of a 
cell. Next the address and density of the pixel found 
is stored in a pushdown list and the four neighboring 
pixels of that pixel are examined in the same 
clockwise order. This continues in a recursive 
manner until no neighbors are foimd above a 
threshold for a particular pixel. At this point the prior 
pixels on the pushdown list are reexamined to 
continue the neighbor search process until the entire 
number of pixels defining a region, i.e., the cell 
object has been identified. Moreover, each of the 
pixels above the threshold of the region are identified 
and a complete enclosed region has been defined for 
a cell. 

Once a cell object is labeled, a cell object table is 
set up for the object. The table lists the address of its 
entry point pixel, the number of pixels in the object, 
the X, Y points for the minimum and maximum 
points of the object, a count of the pixels in the 
perimeter of the object, the sum of the optical density 
of the object pixels, any classification provided for 
the object, and the X, Y coordinates of the field to 
which the object belongs. A plurality of the cell 
object tables comprise a temporary array, called a 
field array, which is used to store the interactive data 
developed for the present field image under 
consideration. 

Next, a box or identifying border is placed 
around the object using the X, Y limits. This mode 
identifies a particular object in the field for the 
operator. A key handler is entered to obtain a key 
press from the operator to determine which of the key 
functions of the classification function are to be 
acconqjlished. The key handler further determines 
which operation, either for calibration or analysis, is 
to be performed and only those keys associated with 
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the present mode are enabled, all others are locked 
out. Once a key has been obtained, the program will 
determine which function was selected and the 
progress of the routine. 

Keys 0-5 as detected provide for the acceptance 
of a calibration object or the classification of a 
specimen object. If such key is detected, then the 
object is colored (red) to indicate to die operator that 
it has been accepted or classified. The operator 
classifies the cell objects into different categories 
based upon visual clues such as morphology and the 
optical markings. The cells for analysis can be 
classified into a normal class 0, or one of several 
abnormal classes 1-5. The data class of the object is 
stored to its place in the associated object data table. 
Calibration objects are classified as type 0 or normal. 
The program then returns to where the image 
operation [scan?] registers are incremented to operate 
[scan?] the field for the next object. 

Alternatively, if the key press was a 9 as this 
means either a calibration cell object was rejected or 
a current specimen cell object was rejected. Thus, the 
rejected cell object is colored in a different color 
(white) than an accepted or classified cell object, and 
the program returns to the scanning routine to find 
another object. Coloring the cell object alerts the 
operator that the object has been analyzed in this 
field, coloring the object another color differentiates 
the object fi-om an accepted or classified cell object. 
If, however, the key press is a CTRL/Fl, then the 
operator desires to move the identification box to the 
last previously measured object. The program will 
then interrogate the field array to find tiie last object 
pointer. This pointer is used to create the box around 
the previous cell object before getting another key 
press. By using a series of CTRL/Fl keys the 
operator may selectively move the identifying box 
firom previously measured cell object to previously 
measured cell object in a reverse direction. If, after 
the box is placed around a particular cell object, the 
operator desires to reclassify that cell object, he then 
has the option of classifying it with the keys 0-5 in 
block A326. 

The identifying box may be moved to the next 
unmeasured cell object by selecting the key 
CTRL/F2. The key, if found, immediately returns the 
program control to the image operation [scan?] entry. 
The effect of this operation is to allow the operator to 
skip the present cell object and move the identifying 
box to the next cell object without either rejecting or 
accepting the present cell. A series of CTRL/F2 
presses will move die box forward through the cells 
without measuring them. 

If all of the cell objects in a particular field 
appear normal as specimen cells, or as is generally 
the case with control cells they are acceptable, the 



operator may want to classify them all automatically. 
To accomplish this, an operator presses the key 
CTRL/F3. This key press is detected and transfers 
control to where the automatic mode flag is set. The 
program then returns to the entry of the image scan. 
However, instead of going through the normal 
sequence of placing a box around the next object and 
waiting for a key press, the program will loop to 
automatically classify the rest of the cells of a field. 

Another option that the operator can select is the 
cell cutting function that is entered by pressing the 
key CTRL/F4. This key is detected and transfers 
control to the cell cutting function operation. When 
the CTRL and F4 keys are pressed, the user is 
permitted to cut lines inside the identifier box. The 
operator cannot make a cut line over a pixel that 
belongs to a measured or a rejected cell. A measured 
cell is a cell that has been classified as type 0, 1,2, 3, 
4, or 5. Numeric lock must be activated in order to 
perform a cell cutting operation. A cross hair is 
located where the cut is to take place. The following 
table lists the cell cutting operations that can be 
performed plus the key that must be pressed in order 
to select the desired operation. The function allows 
the splitting of overlapping cells by artificially 
making a perimeter between two areas, a cut. Thus, 
the labeling routine will only label one area as a cell 
object. 



(KEY) (ACTION) 



0 Turn splitting on and off 

1 Go down and left one step 

2 Go down one step 

3 Go down and right one step 

4 Go left one step 

5 Go to the center of the box 

6 Go right one step 

7 Go up and left one step 

8 Go up one step 

9 Go up and right one step 
ENTER Re-do last step (up to 100 pixels) 
ESC Exit cell splitting mode 



A step is three pixels. When beginning a new 
cut, the first pixel will not be cut. For operation 5, the 
cross hair will not move if the center pixel belongs to 
a measured or rejected cell. 

After the cell cutting is performed in, the scanner 
registers are set to the entry point of the particular 
object cut. The program then returns to the scan 
entry. Because the cell object has the same entry 
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point but a different perimeter, the labeling routine 
will label the cell object as now cut. 

Another option that the operator has is the ability 
to select any object within a field. The selection of 
this mode is accomplished by pressing the CTRL/F5 
key. 

When the CTRL and F5 keys are pressed, the 
user enters the selection mode. Numeric lock must be 
operable in order to perform a selection operation. A 
cross hair will appear at the current selection point. 
The following table lists the selection operations that 
can be performed plus the key that must be pressed in 
order to select the desired operation. 



(KEY) (ACTION) 



0 


Select cross hair movement step size 




[5 or 15] 


1 


Go down and left one step 


2 


Go down one step 


3 


Go down and right one step 


4 


Go left one step 


5 


Go to the center of the image 


6 


Go right one step 


7 


Go up and left one step 


8 


Go up one step 


9 


Go up and right one step 


ESC 


Exit selection mode 



When the selection mode is exited, the box will 
move to the furst unmeasured cell after the selection 
point. If there are no cells after the cross hair, the box 
will go to the next unclassified cell. 

After the object is selected by the above 
technique, the scanner registers are set to the entry 
point of that particular object in block A348 and the 
program returns to the scan entry in block A300. This 
creates the identifier box around the object using its 
X, Y limits and provides the operator with the option 
of then pressing another key and performing other 
measurements and classifications on that selected 
object. 

Another ftmction is provided by key CTRL/F6. 
This feature provides an operator with the ability to 
move the identifier box forward by reading the next 
cell object pointed to and then drawing aroimd the 
box the chosen object in block A3 13. The keys 
CTRL/Fl, CTRL/F2 thereby allow an operator to 
quickly revise previous cell classification by stepping 
forward and backwards, respectively, through the 
pointers of the previously measured cells. 

When the enter key is confirmed, the cell object 
array is updated with the present field array to store 
all of the data collected for the particular objects in 



the field. Alternatively, the confirmation of the 
escape key being pressed returns the program 
immediately to the place in the software where it was 
called. 

It will be appreciated diat the illustrated control 
22 has been programmed to do the cell classification 
and optical density analysis. Such classification and 
analysis is similar to that outlined in U.S. Pat. 
4,453,266 for the classification or red blood cells and 
the present invention can be particularly useftil in the 
analysis of red blood cells wherein the optical density 
of the hemoglobin content is measured rather than the 
DNA content as above described. As common in red 
blood cell analysis, the red blood cells need not be 
stained for image enhancement so that the staining 
calibration step may be eliminated for red blood cells 
when using the specific wavelength of light specified 
in the aforementioned Bacus patents. 

A further use of the present invention is to 
provide a precise measurement of hemoglobin in 
actual picograms for calibrating other instruments 
such as a Coulter counter. In such a process, the 
control blood cells 40 will have a known 
predetermined hemoglobin value and the specimen 
blood cells 52 of unknown hemoglobin value will be 
placed on the specimen area 58. Then the apparatus 
will be calibrated to show the histogram for the 
hemoglobin content of the specimen cells 52. 

It will also be appreciated that the various 
calibration steps may be eliminated or combined and 
done simultaneously rather than done in the order and 
in the sequence and in the manner described for the 
preferred embodiment of the invention in making a 
DNA analysis. 

While a preferred embodiment of the invention 
has been illustrated, it will be obvious to those skilled 
in the art that various modifications and changes may 
be made thereto without departing from the spirit and 
scope of the invention as defined in the appended 
claims. 

4. Brief Description of the Drawings 

Fig. 1 is a pictorial representation of an image 

analysis system constructed in accordance 
with the invention; 

Figs. 1 A-ID illustrate different histograms for 
anueploidy analysis; 

Fig. 2 is a functional block diagram of the image 
analysis system illustrated in Fig. 1 that is 
adapted to perform the methods for the 
quantification of nuclear DNA in 
accordance with the invention; 

Fig. 3 is schematic block diagram of the image 

acquisition apparatus illustrated in Fig. 2; 
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Fig. 4 is a functional system diagram illustrating the 
major operations of the system control 
illustrated in Fig. 2; 

Figs. 5 and 6 are top perspective and cross-sectional 
views, respectively, of a slide particularly 
adapted for use in the image analysis system 
illustrated in Fig. 1 and having separate 
areas for calibration cell objects and 
specimen cell objects; 

Fig. 7 is a pictorial view at the microscopic level of 
the binding effects of a monoclonal 
antibody; 

Fig. 8 is a graphical representation of the % of light 
transmission as a function of light 
wavelength for the two stains and the two 
color filters used in accordance with the 
invention; 

Figs, 9, 10, and 1 1 are pictorial representations of 
images of a cell population showing an 
unfiltered image, a red filtered image, and a 
blue filtered image, respectively; 

Fig. 12 is a functional flow chart of a method of 

quantifying DNA for human carcinoma in 
accordance with the invention; 

Fig. 13 is a pictorial representation of the image 
monitor 37 during the selection process, 
illustrating the marked cells; 

Fig. 14 is a pictorial representation of the many 

optical fields on the slide illustrated in Figs. 
5 and 6; 

Fig. 1 5 is a pictorial representation of the calibration 

screen that appears on ±e instruction 

monitor illustrated in Fig. 1 ; 
Fig. 16 is a pictorial representation of the analysis 

screen that appears on the instruction 

monitor illustrated in Fig. I ; 
Fig. 17 is a system flowchart of the analysis system 

screen architecture of the image analysis 

system illustrated in Fig. 1 ; 
Fig. 18 is a functional flow chart of the main menu of 

the main screen illustrated in Fig. 17; 
Fig. 19 is a functional flow chart of the compose 

[calibrate?] menu of the con:q)ose 

[calibrate?] screen illustrated in Fig. 17; 
Fig. 20 is a functional flow chart of the adjust blue 

boundary menu of the adjmt blue boundary 

screen illustrated in Fig. 17; 
Fig, 2 1 is a functional flow chart of the adjust red 

boundary menu of the adjust red boundary 

screen illustrated in Fig. 17; and 
Fig 22 is a functional flow chart of the analysis menu 

of the analysis screen illustrated in Fig. 17. 



Agent: Kyozo Yuasa, Benrishi [Patent Agent] 
[Official seal] (And four others) 



Handwriting in Drawings Rewritten 
(No Changes to Content) 

Figs. lA-lD 

Horizontal axis: relative mass 
Vertical axis: cell number 

Fig. 2 

18: image acquisition apparatus 
19: strength 

2 1 : image processing interface 

22: system control 

23: image processing interface 

25: optical splitter 

34: position interface 

35: keyboard interface 

36: keyboard 

37: image monitor 

38: printer 

39: image monitor interface 

41: printer interface 

61: instruction monitor interface 

62: instruction monitor 

71: memory control 

73: RAM 

75: disk drive 

Fig. 3 

Upper: red light 
Lower: blue light 

Fig. 4 

80: meter control logic 

image and instruction control logic 

memory control logic 

image acquisition control logic 

position acquisition control logic 

printer and keyboard control logic 

82: patient marker 
84: light level 
86: position calibration 
88: control cell calibration 
90: boimdary formation 
91: selected cell marking 
92: cell data acquisition 
93: cell classification 
94: cell analysis 
95: utility 

96: result report preparation 
Fig. 7 

Near 188: bridging antibody 
Near 180: primary antibody 



Fig.8 

Horizontal axis: wavelength (nanometers) 
Vertical axis: transmission (%) 
Near 480: blue filter 
Near 620: red filter 

Fig. 12 
start 

250: stain cytoplasm 
252: stain DNA 
254: set light level 
Red 

256: acquire control cell image 
Red 

260: measure control cells 

262: move to next field 

264: finished? 

No: to 262 

Yes: to 266 

blue 

266: acquire cytoplasm image 
blue 

268: set cytoplasm boundary 
red 

270: acquire DNA image 
red 

272: set DNA boundary 
274: mark selected cells 
276: classify imaged cells 
278: measure imaged cells 
280: display analysis 
282: finished? 
Yes: to complete 
No: to 284 

284: move to next field 
Fig. 17 

A 12: main screen 

A 14: calibrate screen 

A 16: analysis screen 

A 18: adjust blue boundary screen 

A20: adjust red boundary screen 

Fig. 15 
[above graph] 

quantitative immunoploidy analysis 
calibrate screen 
use red filter 

patient record: John Doe 

number: 987654321 
DNA index based on 7. 18 picograms 

Calibrated DNA Distribution 
Horizontal axis: relative DNA volume 
Vertical axis: cell number 
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[to right of graph] 

calibration data 

Ught level 130 

cell number 20 

peak value 10,600 

measurement control 
0 = accepted cell 
9 = rejected cell 
<CR> = Stop/save data 
<ESC> = Stop 
CTRLFl = backup 
CTRL F2 = Next sanqDle 
CTRL F3 = automatic 
CTRL F6 = forward 

CK-light 

setting-XY 

focus 

measure 

XY 

analyze 
clear all 
help 



Fig. 16 
[above graph] 

Quantitative immunoploidy analysis 
analysis screen 

patient record: John Doe 

number: 987654321 
DNA index based on 7.18 picograms 

DNA Mass Distribution 

Horizontal axis: DNA mass (picograms) 

Vertical axis: cell number 



[to right of graph] 
light level 
cell type 

main peak 
mass 
index 
region 

secondary peak 

mass 

index 

region 



results of count 



130 
N 



II. 3 pg 
1.57 

III. 3 \im^ 



22.6 pg 
3.15 

187.3 ^m^ 



total 

display number 
off scale 

analysis 

clear-type 

select-secondary 

region- 1 -2 

focus 

CK-light 

display-XY 

XY 

clear 

prepare report 

scale 

mask 

boundary 

boundary 

help 

main 

region 1 
region 2 



Fig. 18 
main menu 
A22: 1. san^le 

2. label 

3. light setting 

4. calibration 

5. finish 



38 
27 
0 



-G 
-R 



0 
0 



[A24-A32 same as Items 1-5.] 



Fig. 19 

calibrate screen 
A34: 1. light check 

2. X-Y setting 

3. focus 

4. measurement 

5. XY-1 

6. analysis 

7. main 

[A36-A48 same as Items 1-7.] 



Fig. 20 

correct blue boundary menu 
A50 1 . set step size -B 

2. toggle -B 

3. enlarge -B 

4. reduce -B 
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5. finish 



[Page 34] 



[A52-A60 same as Items 1-5.] 
Fig. 21 

correct red boundary menu 
A50 1. set step size -R 



2. toggle -R 

3. enlarge -R 

4. reduce -R 

5. finish 



[A64-A72 same as Items 1-5.] 



Fig. 22 

analysis menu 

A74: 1. delete -type 

2. classify 

3. focus -2 

4. CK-hght -2 

5. select -secondary 

6. region -1-2 

7. display -XY 

8. clear -2 

9. XY -2 

10. report preparation 

11. scale 

12. boundary -B 

13. boundary -R 

14. main 

15. mask 

16. delete 

[A76-A106 same as Items 1-16.] 
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To: Fumimasa Yoshida 

Director-General of Patent Office 

1 . Indication of Matter 

Showa 63 [1988] Patent Application 291014 

2. Title of the Invention 

Methods and apparatus for immunoploidy analysis 

3. Amending Party 

Relationship to Matter: Patent Applicant 
Address: [blank] 

Name: Cell Analysis Systems, Inc. 

4. Agent 

Address: Shinotemachi Bldg. No. 206 

2-2-1 Otemachi, Chiyoda-ku, Tokyo 
Phone: 270-6641 to 6646 
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5. Subject of Amendment 

Refinement of specification and applicable drawings 
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Applications Section]] 

6. Content of Amendment 

See attachments (Note that no changes to content of 
specification or drawings were made.) 
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